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(54) Title: MEANS FOR MEASURING PICTURE QUALITY USING OPTICAL PATTERN RECOGNITION 



(57) Abstract 

The invention relates to means for measuring picture 
quality of various types of visual pictures and documents us- 
ing optical pattern recognition. The means comprises an 
optical recognition equipment with adapted recognition sen- 
sitivity and an algorithm for calculation and analysis of er- 
ror frequencies, together with a test pattern. The invention 
enables measuring an unknown test object, a picture or a 
document, using e.g. an OCR program with adapted recog- 
nition sensitivity in a reliable way with respect to readability 
and resolution. 





Bokstdverna far sitt sanna behag inte 
ndr de skrivs i bradska och med olust 
inte heller nar de kommer till blott ge- 
nom flit och moda utan forst dd de ska- 
pas i kdrlek och glddje. 

Giambattista Bodoni 

ABCDEFGH UK L M NOPQRSTU VWX YZ 
abcdefghijklmnopqrstuvwxyz 1234567890 

ABCDEFGH 1 JKL MNOPQRST U V WX YZ 
abcdefghijklmnopqrstuvwxyz 1234567890 

ABCDEFGH1JKLMNOPQRSTUVWXYZ 
abcdefghijklmnopqrstuvwxyz 1234567890 

ABCDEFGH1JKLMNQPQRSTUVWXYZ 
abcdefghijklmnopqrstuvwxyz 1234567890 

ABCDEFGHIJKLMNOPQRSTUVWXYZ 
abcdefghijklmnopqrstuvwxyz 1234567890 

ABCDEFGHIJKLMNOPQRSTUVWXYZ 
abcdefghijklmnopqrstuvwxyz 1234567890 

Slumpmassig ordning av dessa bokstdver 




FOR THE PURPOSES OF INFORMATION ONLY 

Codes used to identify States party to the PCX on the front pages of pamphlets publishing international 
applications under the PCT. 



AT Austria 

A If Australia 

BB Barbados 

BE Belgium 

BF Burkina Faso 

BG Bulgaria 

BJ Benin 

BR Brazil 

CA Canada 

CF Central African Republic 

CG Congo 

CH Switzerland 

CI Cote dMvoire 

CM Cameroon 

CS O-cchosIovakia 

CZ Czech Republic 

DE Germany 

DK Denmark 

ES Spain 

Fl Finland 



FR France 

CA Gabon 

CB United Kingdom 

GN Guinea 

GR Greece 

HU Hungary 

IE Ireland 

IT Italy 

JP Japan 

KP Democratic People's Republic 

of Korea 

KR Republic of Korea 

LI Liechtenstein 

LK Sri Lanka 

LU Luxembourg 

MC Monaco 

MC Madagascar 

ML Mall 

MN Mongolia 



MR 


Mauritania 


MW 


Malawi 


NL 


Netherlands 


NO 


Norway 


NZ 


New Zealand 


PL 


Poland 


PT 


Portugal 


RO 


Romania 


RU 


Russian Federation 


SD 


Sudan 


SE 


Sweden 


SK 


Slovak Republic 


SN 


Senegal 


su 


Soviet Union 


TD 


Chad 


TC 


Togo 


UA 


Ukraine 


US 


United Slates or America 


VN 


Viet Nam 



WO 93/07581 



PCT/SE92/00695 



APPLICANT: TELEVERKET 

TITLE OF INVENTION: MEANS FOR MEASURING PICTURE QUALITY USING 

OPTICAL PATTERN RECOGNITION 



FIELD OF THE INVENTION 

10 The present invention relates to means for objective 

measurement of picture quality and, more specifically/ means 
for characterizing picture quality of various types of visual 
pictures and documents using optical pattern recognition. 

The expression characterization of picture quality means 

15 that the picture quality is described with objective 

measures, such as the likelihood of a person confusing an in- 
tended character with another character within a character 
set system, the degree of accuracy in reproducing a grey 
scale gradient, the signal/noise ratio, MTFA (Modulation 

20 Transfer Function Area) value, the likelihood of considering 
the overall picture quality of a given application accept- 
able, etc. 

The term visual pictures and documents relates to visual 
information presented on information carriers in the form of 
25 e.g. paper documents, films, electrooptical displays. 

The term optical pattern recognition relates to an 
electrooptical system designed to determine automatically the 
presence of specific picture elements . 

30 STATE OF THE ART 

Examples of known prior art of this type is optical 
character recognition (OCR) , which is designed to recognize 
automatically alphanumerical characters (combinations of 
horizontal, vertical and slanted lines, closed and open 

35 curves, etc.). If the character in question is not alpha- 
numerical (but e.g. consists of EAN codes) this method is 
usually called Optical Mark Recognition (OMR) . 

In certain applications the pattern recognition may be 
"absolute" in that the pattern in question is standardized, 

40 which is the case in traditional OCR for alphanumerical 
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characters. In other applications it .ay be required that the 
pattern recognition is "relative", which means that the 

relative to an ideal test picture 
pattern recognition is relative 

specially designed for the application. 
5 The OCR and OMR technique is based on a computer program 

designed to optimize the likelihood of classifying correctly 
an input character. This automatic character recognition re- 
tires that the input characters are of a certain miniumum 
quality. They are not intended for operation with texts of 

? a -Hi-v since it has been found that if the recogni- 

LO lower quality, since ii. -> 

tion level is lower than approximately 90-95 % a too great 
manual supplementary wort is retired and. therefore it „ 
better to perform the whole character recognition (readrng) 

manually.^ ^ ^ ^ ^ ^ techn igue of optical recog- 
nition to develop this for a measuring device for picture 
guality. No one has used the recognition degree, which may 
vary between 0 and 100 %, as an objective measure of pxcture 
JL*. No one has used a test pattern containing a text and 
20 a graphic picture, as a basis for OCR/ OMR measurement of 
picture quality. 

SUMMARY OF THE INVENTION 

The present invention provides means for objective 

25 measurement of picture quality comprising, on one hand an 
optical recognition equipment, and on the other hand a test 
pattern. The recognition equipment (e.g. a scanner with 
OCR/OMR software) has a calibrated recognition sensitivity 
and an algorithm for calculation and analysis of error fre- 

30 quencies. Further embodiments are set forth in the accom- 
panying claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention will now be described in detail with refe- 
35 rence to the accompanying drawings, in which: 

Fig 1 shows a test pattern for facsimile printouts; 
Fig 2 shows an example of a set of test patterns; and 
Fig 3 shows an example of an analysis of misinterpreta- 



tions . 



40 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS OF THE 
INVENTION 

The present invention provides means for objective 
measurement of picture quality, mainly comprising an optical 
5 recognition equipment and test patterns. The optical recogni- 
tion equipment, e.g. a scanner with OCR/OMR software, has a 
calibrated recognition sensitivity and an algorithm for 
calculation and analysis of error frequencies. The 
recognition degree is high when the picture quality is high. 

10 The recognition degree should be sufficiently low when the 

picture quality is low. The test patterns contain information 
in various directions such that the picture quality can be 
assessed in its entirety. 

The following examples illustrate the construction and 

15 the use of the invention. 

Example 1. In microfilming it is common that the first 
picture frame is a photograph of a standardized test picture. 
After development the photographed test picture is enlarged 
and it is examined with respect to its reproduction in an 

20 acceptable way in the filming process. Using the present 

invention the quality control may be performed automatically 
and in an objective way. 

Example 2 . Scanning a document for optical storage re- 
quires that the scanning equipment continuously is adjusted 

25 to enable optimal recording of e.g. lead pencil writing mixed 
with ballpoint pen writing and typewritten text. Using the 
present invention the quality control can be performed 
directly and automatically control the scanning equipment 
setting parameters to obtain optimal picture quality. 

30 Example 3. In transmitting still pictures over the 

telephone network a picture telephone user using the present 
invention can establish if the picture quality of the 
document display equipment will be acceptable with ISDN coded 
transmission. The transmitting party can print using a video 

35 printer before a transmission a test pattern reproduction 

"frozen" in the document camera. Then the printout is input 
in the pattern recognition equipment in which it is scanned 
and characterized in accordance with the software selected, 
e.g. "57 % recognition degree in ISDN transmission of text 

40 having the typeface X and the character size Y". 
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Example 4. Telefax printouts may have different resolu- 
tion in the horizontal and vertical direction. In order to 
characterize the resolution of telefax printouts an appli- 
cable test pattern is needed containing spatial information 
in both directions, as is shown in Fig. 1- To characterize 
readability of telefax printouts, on one hand, an «**"d 
re cognition sensitivity is reguired, and, on the other hand, 
an algorithm for prognostic calculation and analysis of 
interpreted elements. Calibration of sensitivity and recogni- 
tion degree is in this case performed by means of a set of ^ 
test patterns with well-defined physical test results, as is 

shown in Fig. 2. 

The test patterns made with precision in laboratory en- 
vironment, consist of a series of pictures having one and the 
same subject, e.g. a picture or a text, having varyrng 
picture quality. Each test pattern of the series rs characte- 
rized, on one hand, by an objective picture quality measure, 
e g MTFA (Modulation Transfer Function Area) , and on the 
ocher hand, by a subjective measure expressed as quel rty 
judgements as e.g. "excellent", "good", "acceptable , poor 
or "very poor". By means of a series of such test patterns a 
picture produced by means of any reproduction medrum can be 
graded with respect to objective as well as subjective 

picture quality. 

The prognostic analysis of the misinterpretation may 
appear as in Fig. 3, showing error frequencies in a read- 
ability test of a standard picture (Tele Nova Compis; normal 
face) and a test picture (IBM PC Color; bold face) . The total 
average includes data of all 70 characters, but in the figure 
only values are shown for characters having an average error 
frequency greater than 3 % (100 % = 25 errors) . 

Example 5. The picture quality of a closed picture conv- 
ocation system can be monitored using the present inven- 
tion and tested by the transmission side periodically trans- 
mitting a test picture known to the receiving side, which 
picture is analyzed there providing quality judgements to the 
receiving side. The same principle can be used in networks by 
several users and in open systems provided that the user 
collective has an internal standardized test pattern and 
associated test pattern analysis programs. A "quality hand- 
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shake" is obtained if the picture quality analysis is com- 
bined with automatic choice of e.g. channel band width in the 
ISDN network. 

Thus, the present invention provides means automatically 
achieving an objective measurement of the quality of a 
picture or text. Specifically, values of the quality para- 
meters readability and resolution are obtained. A measurement 
of the likelihood of misinterpreting a picture is obtained. 

A person skilled in the art appreciates that the inven- 
tion may be applied in several different ways. The examples 
above are not a complete recitation. The invention is only 
limited by the claims below. 
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CLAIMS 

1. Means for objective measurement of picture quality of 
reproduction media using optical pattern recognition, 
characterized in that a pattern recognition equipment to- 

5 gether with a test pattern are used to objectively measure 
and read the quality parameters readability and resolution of 
a picture or text. 

2. Means according to claim 1, characterized in that 
measurement and characterization of the quality parameters 

10 readability and resolution of a picture or text are performed 
by prognostic calculation and analysis of misinterpreted ele- 
ments . 

3. Means according to claim 1, characterized in that 
the pattern recognition equipment with the test pattern, in 

15 dependence of the field of application, is adapted and cali- 
brated with respect to recognition sensitivity and degree. 

4. Means according to claim 1, characterized in that 
adaptation and calibration of the recognition sensitivity and 
degree is applied to a series of physical or electronical 

20 test patterns containing pictures and/or texts with varying 
and physically well-defined test results and the corre- 
sponding subjective expressions. 
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Lingonen brukar mogna i 
September och sikten dr 
ganska skymd i kurvan, 
men manga trivs med att 
vandra i fjallen. 



1. MTFA: 10,6 
Picture quality: 
Very good 

2. 



Lingonen brukar mogna i 
September och sikten dr 
ganska skymd i kurvan, 
men manga trivs med att 
vandra i: fjallen. 



Lingonen brukar mogna i 
September £ch sikten ar 

» 

ganska skymd i kurvan, 
men nianga -trivs med att 
vandra i fiailen. 



3. MTFA: 7.7 
Picture quality: 
Acceptable 



5. 



6. MTFA-. SA 
Picture quality: 
Very poor 

7. 
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